Input control method, device, and electronic apparatus

ABSTRACT

An input control method includes, in response to entering a first state, turning on a first mode, the first state being a state requiring input, and receiving first data sent by a first apparatus, the first data being data associated with the first mode.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to Chinese Patent Application No.202111673869.9, filed on Dec. 31, 2021, the entire content of which isincorporated herein by reference.

TECHNICAL FIELD

The present disclosure generally relates to the control technology and,more particularly, to an input control method, device, and electronicapparatus.

BACKGROUND

Currently, an augmented reality (AR) apparatus and a virtual reality(VR) apparatus usually use a virtual keyboard for input, which has lowoperation efficiency and poor user experience.

SUMMARY

Embodiments of the present disclosure provide an input control method.The method includes, in response to entering a first state, turning on afirst mode, and receiving first data sent by a first apparatus, Thefirst state is a state requiring input. The first data is dataassociated with the first mode.

Embodiments of the present disclosure provide an input control device,including a mode start module and a data reception module. The modestart module is configured to turn on a first mode in response toentering a first state. The first state is a state requiring input. Thedata reception module is configured to receive first data sent by afirst apparatus. The first data is data associated with the first mode.

Embodiments of the present disclosure provide an electronic apparatus,including a memory and a processor. The memory stores executableinstructions. The processor is coupled with the memory and, when theinstructions are executed, configured to, in response to entering afirst state, turn on a first mode, and receive first data sent by afirst apparatus, The first state is a state requiring input. The firstdata is data associated with the first mode.

In the technical solutions, compared with the existing technology,embodiments of the present disclosure provide an input control method, adevice, and an electronic apparatus. The method includes, in response toentering the first state, turning on the first mode. The first state isthe state requiring input. The method further includes receiving thefirst data sent by the first apparatus. The first data is the dataassociated with the first mode. In the solution, when the text input isrequired, the text input is not performed locally. The text data to beinputted may be obtained from the first apparatus. Thus, when thecurrent apparatus is inconvenient to perform the text input, the usercan use the first apparatus to perform the text input. After performingthe text input, the local apparatus may obtain the required text datafrom the first apparatus. With the solution, the problem of inconvenientinput in some apparatuses that are inconvenient to perform text inputoperations may be solved. The user experience may be improved.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a schematic flowchart of an input control methodaccording to embodiments of the present disclosure.

FIG. 2 illustrates a schematic flowchart of another input control methodaccording to embodiments of the present disclosure.

FIG. 3 illustrates a schematic diagram showing a display interface of afirst apparatus according to embodiments of the present disclosure.

FIG. 4 illustrates a schematic diagram showing another display interfaceof a first apparatus according to embodiments of the present disclosure.

FIG. 5 illustrates a schematic diagram showing an interaction timesequence of an input control method according to embodiments of thepresent disclosure.

FIG. 6 illustrates a schematic structural diagram of an input controldevice according to embodiments of the present disclosure.

FIG. 7 illustrates a schematic structural diagram of an electronicapparatus according to embodiments of the present disclosure.

DETAILED DESCRIPTION OF THE EMBODIMENTS

The technical solutions of embodiments of the present disclosure aredescribed in detail below in connection with the accompanying drawingsof embodiments of the present disclosure. Apparently, describedembodiments are only some embodiments of the present disclosure, not allembodiments. Based on embodiments of the present disclosure, all otherembodiments obtained by those of ordinary skill in the art withoutcreative efforts shall fall within the scope of the present disclosure.

FIG. 1 illustrates a schematic flowchart of an input control methodaccording to embodiments of the present disclosure. As shown in FIG. 1 ,the input control method includes the following processes.

At 101, in response to entering a first state, a first mode is turnedon. The first state is a state requiring input.

The input control method may be applied to various types of electronicapparatuses, which are not limited by embodiments of the presentdisclosure. The input control method may solve the problem ofinconvenient text input for electronic apparatuses. For example, forsome wearable apparatuses, such as a virtual reality (VR) apparatus oran augmented reality (AR) apparatus, since the apparatuses are worn by auser on the head, when text input is required, the user usually may needto keep moving the head to select an input character and confirm theselection. The input process may be slow, and the user may easily feeltired. Therefore, for these electronic apparatuses that are inconvenientfor text input, the present disclosure provides a solution to realizeconvenient and efficient text input. The wearable apparatus may be usedas an example of an execution body for the input control method of thepresent disclosure for description to facilitate understanding.

The first mode may be a mode indicating that a system activates acertain function or a mode indicating different operation states of acertain function. Different implementations of the first mode may bedescribed in detail below and are not described here.

At 102, first data sent by a first apparatus is received. The first datais data associated with the first mode.

After the first mode is turned on, the system may trigger the firstapparatus to obtain the first data and transmit the obtained first datato the system. The first data may be text content that needs to beinput. The first data may be obtained by the user performing inputthrough an input interface including a virtual keyboard. That is, thefirst data may be the data received by the first apparatus from an inputdevice of the first apparatus. In some embodiments, the input device ofthe first apparatus may be a physical input device or a virtual inputdevice. After the system receives the first data, a corresponding textinput operation may be realized.

Different implementations may exist for the system to trigger the firstapparatus to obtain the first data. For example, after turning on thefirst mode, the system may send an instruction to the first apparatus toinstruct the first apparatus to obtain the first data. In some otherembodiments, after turning on the first mode, the system may send somedata contents to the first apparatus. Thus, after performing parsing andrecognition on the data contents, the first apparatus may directly entera page of obtaining the first data.

The first data may be associated with the first mode, which means thatafter entering the first mode, the first apparatus can enter a conditionof obtaining the first data.

The first apparatus may include an electronic apparatus such as a mobilephone, a PAD, a tablet computer, a notebook computer, etc., as long asthe device can conveniently perform text input through an input devicesuch as a hand or a stylus pen. The first apparatus and the executionbody of the input control method of the present disclosure may beconnected in a plurality of manners for data exchange. The firstapparatus and the execution body may be connected and matched notlimited to any one of Bluetooth, network, and physical connection.

In the input control method of embodiments of the present disclosure,when the text input needs to be performed, the text input may not beperformed locally, but the text data that needs to be input may beobtained from the first apparatus. Thus, when the current apparatus isinconvenient for text input, the user may perform text input through thefirst apparatus. Then, the local apparatus may obtain the required textdata from the first apparatus. With this implementation, the problem ofinconvenient input in some apparatuses that are inconvenient to performa text input operation may be solved, and the user experience may beimproved.

In some embodiments, turning on the first mode in response to enteringthe first state may include, in response to entering the first state,turning on an image capture mode to obtain and output the first displayinformation of the first apparatus. The first display information may atleast include an input interface of the first apparatus.

In some embodiments, since the user wears the wearable apparatus on thehead, such as the VR apparatus, the user cannot see an externalenvironment. Thus, even if the first apparatus can be configured toperform the text input conveniently, the user cannot see the firstapparatus. Therefore, in some embodiments, a camera of the wearableapparatus may be configured to collect and obtain an image in a certainarea in front of a user face. When the user handhelds and places thefirst apparatus in front of the user. The wearable apparatus may collectan image of the first apparatus, including a display of the firstapparatus or a physical input device of the first apparatus. The firstdisplay information may be the input interface of the first apparatus.That is, as long as the first display information includes content thatsatisfies the user to perform the text input, for example, a text inputwindow or a virtual keyboard.

After the image of the first apparatus is obtained, that is, after thefirst display information is obtained, the first display information maybe directly controlled and output in the display area. Thus, the usermay see the image of the first apparatus in front of the user andperform the text input on the first apparatus by controlling thefingers. The camera of the wearable apparatus may be used as an eye forthe user to see the external environment. Thus, the user may perform thetext input on the external first apparatus when using the wearableapparatus on the head.

In some other embodiments, turning on the first mode in response toentering the first state may include, in response to entering the firststate, turning on a screen unshielded mode to cause no content to beoutput on the display screen.

In some embodiments, the user may wear the wearable apparatus on thehead, such as the AR apparatus. Since the screen of the AR apparatus hasa certain degree of transparency, when the user wears the AR apparatus,when the screen of the AR apparatus is in the screen unshielded mode,the user can see the external environment through the screen of the ARapparatus.

After the screen unshielded mode is turned on, the user can see theexternal environment. Thus, the user can see the first apparatus andperform the text input operation on the first apparatus.

The first state may be determined by detecting the output content of thedisplay area, for example, detecting that the display page on thedisplay screen includes a text input window. In some embodiments, thefirst state may also be determined after a specific input instruction isdetected. The specific input instruction may be a voice instruction,such as an audio instruction of “please enter the password” from aspeaker. In some embodiments, when the first mode may be entered basedon the audio instruction, the display content of the display area mayinclude the text input window or may not include the text input window,which is not limited by the present disclosure.

Based on the above content, when the current display page is detected toinclude the first object, such as the text input window, entering thefirst state may be determined. In some other embodiments, when the datainput instruction is recognized, such as the audio instruction, enteringthe first state may be determined.

FIG. 2 illustrates a schematic flowchart of another input control methodaccording to embodiments of the present disclosure. As shown in FIG. 2 ,in some embodiments, the input control method includes the followingprocesses.

At 201, in response to entering a first state, the first mode is turnedon. The first state is a state requiring input.

At 202, second data is sent to the first apparatus. The second dataincludes an input object that needs to perform text input.

The input object that needs to perform the text input may include, butis not limited to, a text input window. When the output page of thewearable apparatus includes an input object that needs to perform thetext input, it may indicate that the text input currently needs to beperformed. In this case, the input object on the current page may bepackaged and sent to the first apparatus. Thus, after parsing andobtaining the input object, the first apparatus may perform the textinput to obtain the first data.

At 203, the first data sent by the first apparatus is received. Thefirst data may be data associated with the first mode.

In some embodiments, after entering the first state, the system maypackage and send the text input object in the current display page tothe first apparatus. Thus, after the first apparatus parses and obtainsthe text input object, the user can conveniently enter text informationin the input object. A display effect of the input object on thewearable apparatus side may be the same as the display effect on thefirst apparatus. Thus, the user may not experience a jumping sense, andthe user input experience may be improved.

In some embodiments, in addition to the input object that can performthe text input, the second data may also include a context attribute ofthe input object. The context attribute may be used to indicate a typeof text that needs to be entered in the input object.

After receiving the second data, the first apparatus may obtain theoriginal content of the second data through decoding and may furtherdetermine which type of text input needs to be performed based on thecontext attribute. For example, the original content of the context maybe “please enter your password.” Thus, the context attribute maycorrespond to character input, and the first apparatus may directly callup a character keyboard for the user to directly perform numeric inputon a numeric keyboard. The display interface of the first apparatus isillustrated in FIG. 3 . For another example, if the original content ofthe context is “please answer the preset question,” then the contextattribute may correspond to the text input. Thus, the first apparatusmay call up the virtual keyboard with nine keys of pinyin based on auser habit. The display interface of the first apparatus is shown inFIG. 4 .

In some embodiments, in order to prevent the user from feelingdisjointed and to prevent the user from forgetting what input needs tobe performed after the wearable apparatus enters the first mode, thecontext attribute may also be the original content of the context. Thus,in addition to displaying the text input window, the first apparatus maydisplay the context to facilitate the user to know what the user needsto enter at any time. As shown in FIG. 3 , the display content of thefirst apparatus further includes “please enter the password” above thetext input window. As shown in FIG. 4 , the display content of the firstapparatus only includes the text input window and the virtual keyboard.

In some embodiments, sending the second data to the first apparatus mayinclude processing the first content in the current display page intoencrypted second data and sending the second data to the firstapparatus. Then, receiving the first data sent by the first apparatusmay include receiving the encrypted first data associated with the inputobject returned by the first apparatus based on the second data.

In some embodiments, encryption processing may be performed on thesecond data sent by the wearable apparatus to the first apparatus andthe first data returned by the first apparatus, which effectivelyensures data security and user privacy. A specific encryption manner anda specific encryption algorithm used between the wearable apparatus andthe first apparatus are not limited by the present disclosure, as longas the user application needs can be met.

In addition, if the user enters data with strong privacy such as apassword, when the user enters password, real input content may not bedisplayed in the text input window. A “*” sign may be used instead ofthe user input content to prevent the password data from being viewed.

FIG. 5 illustrates a schematic diagram showing an interaction timesequence of an input control method according to embodiments of thepresent disclosure. With reference to FIG. 5 , in some embodiments, aninput system module is added to the virtual scene application of thewearable apparatus. The input system module may be configured torecognize the location where the user needs to perform input and thecontext. For example, a login window may require continuously inputtingan account and a password. Through the input system module, the textinput location and the context attribute may be packaged by the inputsystem module. Then, the packaged text input location and the contextattribute may be sent to a cell phone terminal.

After the cell phone receives the above-packaged content, the inputinstruction may be considered to be received. Parsing may be performedon the packaged content to obtain the input scene and the contextattribute. A corresponding program may be started on the cell phone, anda prompt signal may be issued. For example, the cell phone may issue aprompt voice or vibrate. Then, the input window may be automaticallyoutputted, and the virtual keyboard may be called as described above. Insome embodiments, the virtual keyboard and the input window of acorresponding type may be started according to the context attribute.The input window may be an input window that directly displays the inputcontent or an input window that hides the real content and only displays“*” sign.

When the user confirms completion after completing a series of inputs,the input content may be encrypted and transmitted to the input systemmodule of the wearable apparatus. The input system module may performdecryption on the input content. Then, the decrypted input content maybe displayed by the corresponding text input object. Then, the camerawindow of the wearable apparatus may be automatically closed, and thecorresponding application on the cellphone terminal may automaticallyexit, waiting for a next trigger.

The above content describes a specific implementation. The relatedcontent described in embodiments of the present disclosure is understoodin connection with these content and FIG. 5 . Compared with thetraditional text input method of the VR apparatus and AR apparatus, withthe technical solution of the present disclosure, the efficiency andfluency of user input may be significantly improved. Through the camerawindow, the user can operate the first apparatus such as the cellphonewithout additional operations such as taking off the wearable apparatus.The user may conveniently use the apparatus and have high satisfaction.

For a simple description of method embodiments of the presentdisclosure, the method may be described as a series of actioncombinations. However, those skilled in the art should know that thepresent disclosure is not limited by the described action sequence,because certain steps may be performed in another sequence orsimultaneously according to the present disclosure. Then, those skilledin the art should also know that embodiments described in thespecification may be some embodiments of the present disclosure. Theinvolved actions and modules may not be necessarily required by thepresent disclosure.

In embodiments of the present disclosure, the method may be described indetail. The method of the present disclosure may be implemented byvarious forms of apparatuses. Therefore, the present disclosure mayfurther provide a device. Specific embodiments are given below for adetailed description.

FIG. 6 illustrates a schematic structural diagram of an input controldevice according to embodiments of the present disclosure. As shown inFIG. 6 , the input control device 60 includes a mode start module 601and a data reception module 602. The mode start module 601 may beconfigured to, in response to entering the first state, start the firstmode. The first state may be a state that requires input.

The data reception module 602 may be configured to receive the firstdata sent by the first apparatus, where the first data is dataassociated with the first mode.

In the input control device of embodiments of the present disclosure,when the text input needs to be performed, the text input may not beperformed locally, but the text data that needs to be inputted may beobtained from the first apparatus. Thus, when the current apparatusperforms the text input inconveniently, the user may perform the textinput through the first apparatus. Then, the local apparatus may obtainthe required text data from the first apparatus. The problem ofinconvenient text input for the electronic apparatuses that perform thetext input inconveniently. The user experience may be improved.

In some embodiments, the mode start module may be configured to, inresponse to entering the first state, start the image acquisition modeto obtain and output the first display information of the firstapparatus. The first display information may at least include the inputinterface of the first apparatus.

In some embodiments, the mode start module may be configured to, inresponse to entering the first state, start the screen unshielded modeto cause no content to be output on the display screen.

In some embodiments, the input control device may further include astate detection module. The state detection module may be configured todetermine that the apparatus enters the first state when the currentdisplay page is detected to include the first object or determine thatthe apparatus enters the first state when the data input instruction isrecognized.

In some embodiments, the input control device may further include a datatransmission module. The data transmission module may be configured tosend the second data to the first apparatus before the data receptionmodule receives the first data sent by the first apparatus. The seconddata may include the input object that needs to perform the text input.

In some embodiments, the second data may further include the contextattribute of the input object. The context attribute may be used toindicate the type of text that needs to be inputted by the input object.

In some embodiments, the data transmission module may be configured toprocess the first content of the current display page into the encryptedsecond data and send the encrypted second data to the first apparatus.Then, the data reception module may be configured to receive theencrypted first data associated with the input object returned by thefirst apparatus based on the second data.

In some embodiments, the first data may be the data that is inputted bytriggering the input device of the first apparatus received by the firstapparatus.

Any one of the input control devices of embodiments of the presentdisclosure may include a processor and a memory. The mode start module,data reception module, state detection module, data transmission module,etc., may be used as program modules to be stored in the memory. Theprogram modules stored in the memory may be executed by the processor tocause the processor to perform the corresponding functions.

The processor may include a core. The core may call the correspondingprogram module from the memory. One or more cores may be arranged. Thereturn data may be processed by adjusting the parameters of the core.

The memory may include non-persistent memory random access memory (RAM),and/or non-volatile memory of computer-readable media, such as read-onlymemory (ROM) or flash memory (flash RAM). The memory may include atleast one memory chip.

In an exemplary embodiment, a computer-readable storage medium may alsobe provided, which can be directly loaded into the internal memory ofthe computer. The computer-readable storage medium may include softwarecodes. After the computer program is loaded and executed by thecomputer, the processes of the input control method of any embodimentabove may be implemented.

In an exemplary embodiment, a computer program product may also beprovided, which can be directly loaded into the internal memory of acomputer and includes software codes. After the computer program isloaded and executed by the computer, the processes of the input controlmethod of any embodiment above may be implemented.

Further, embodiments of the present disclosure may provide an electronicapparatus. FIG. 7 illustrates a schematic structural diagram of theelectronic apparatus according to embodiments of the present disclosure.As shown in FIG. 7 , the electronic apparatus 70 includes at least aprocessor 701, at least a memory 702 connected to the processor 701, anda bus 703. The processor 701 and the memory 702 may communicate witheach other through the bus 703. The memory may be used to storeexecutable instructions of the processor. The processor may beconfigured to call the program instructions in the memory to execute theabove input control method.

The executable program instructions may include, in response to enteringthe first state, starting the first mode. The first state may be a staterequiring input. The executable program instructions may further includereceiving the first data sent by the first apparatus. The first data maybe the data associated with the first mode.

Embodiments of the present disclosure may be described in a progressivemanner. Each embodiment may focus on the differences from otherembodiments. The same and similar parts between embodiments may bereferred to each other. For the device of embodiments of the presentdisclosure, since the device corresponds to the method of embodiments ofthe present disclosure, the description may be relatively simple, andthe relevant part may be referred to the description of the method.

In the present disclosure, relational terms such as first and second maybe used only to distinguish one entity or operation from another, andmay not necessarily require or imply those entities or operations tohave such actual relationship or order therebetween. Moreover, the terms“comprising,” “including,” or any other variation thereof are intendedto encompass non-exclusive inclusion such that a process, method,article, or device comprising a series of elements includes not onlythose elements, but also includes other elements that are not explicitlylisted or elements inherent to such a process, method, article, ordevice. Without further limitation, an element defined by the phrase“including a . . . ” does not preclude the presence of additionalidentical elements in the process, method, article, or device thatincludes the elements.

The steps of the method or algorithm described in connection withembodiments of the present disclosure may be directly implemented byhardware, a software module executed by the processor, or a combinationthereof. The software modules may be stored in random access memory(RAM), internal memory, read-only memory (ROM), electricallyprogrammable ROM, electrically erasable programmable ROM, registers,hard disk, a removable disk, CD-ROM, or any other storage media that isknown.

The above description of embodiments of the present disclosure mayenable those skilled in the art to implement or use the presentdisclosure. Various modifications to embodiments of the presentdisclosure will be apparent to those skilled in the art. The genericprinciple defined herein may be implemented in other embodiments withoutdeparting from the spirit or scope of the present disclosure. Therefore,the present disclosure may not be limited to embodiments of the presentdisclosure but conform to the widest scope consistent with theprinciples and novel features of the present disclosure.

What is claimed is:
 1. An input control method comprising: in responseto entering a first state, turning on a first mode, the first statebeing a state requiring input; and receiving first data sent by a firstapparatus, the first data being data associated with the first mode. 2.The method according to claim 1, wherein turning on the first modeincludes: in response to entering the first state, turning on an imageacquisition mode to obtain and output first display information of thefirst apparatus, the first display information at least including aninput interface of the first apparatus.
 3. The method according to claim1, wherein turning on the first mode includes: in response to enteringthe first state, turning on a screen unshielded mode to cause no contentto be output on the display screen.
 4. The method according to claim 1,further comprising: in response to detecting that a current display pageincludes a first object, determining to enter the first state; or inresponse to recognizing a data input instruction, determining to enterthe first state.
 5. The method according to claim 4, further comprising,before receiving the first data sent by the first apparatus: sendingsecond data to the first apparatus, the second data including an inputobject that needs to perform text input.
 6. The method according toclaim 5, wherein: the second data further includes a context attributeof the input object, the context attribute being used to indicate a typeof text that the input object needs to input.
 7. The method according toclaim 5, wherein sending the second data to the first apparatusincludes: processing a first content in the current display page intothe encrypted second data and sending the encrypted second data to thefirst apparatus; and receiving the first data sent by the firstapparatus includes: receiving the encrypted first data associated withthe input object returned by the first apparatus based on the seconddata.
 8. The method according to claim 1, wherein the first data is datareceived by the first apparatus to trigger input from an input device ofthe first apparatus.
 9. An input control device comprising: a mode startmodule configured to turn on a first mode in response to entering afirst state, the first state being a state requiring input; and a datareception module configured to receive first data sent by a firstapparatus, the first data being data associated with the first mode. 10.The device according to claim 9, wherein in response to entering thefirst state, the mode start module is further configured to: turn on animage acquisition mode to obtain and output first display information ofthe first apparatus, the first display information at least including aninput interface of the first apparatus.
 11. The device according toclaim 9, wherein in response to entering the first state, the mode startmodule is further configured to: turn on a screen unshielded mode tocause no content to be output on the display screen.
 12. The deviceaccording to claim 9, wherein the first data is data received by thefirst apparatus to trigger input from an input device of the firstapparatus.
 13. An electronic apparatus comprising: a memory storingexecutable instructions; and a processor coupled with the memory and,when the instructions are executed, configured to: in response toentering a first state, turn on a first mode, the first state being astate requiring input; and receive first data sent by a first apparatus,the first data being data associated with the first mode.
 14. Theapparatus according to claim 13, wherein the processor is furtherconfigured to: in response to entering the first state, turn on an imageacquisition mode to obtain and output first display information of thefirst apparatus, the first display information at least including aninput interface of the first apparatus.
 15. The apparatus according toclaim 13, wherein the processor is further configured to: in response toentering the first state, turn on a screen unshielded mode to cause nocontent to be output on the display screen.
 16. The apparatus accordingto claim 13, wherein the processor is further configured to: in responseto detecting that a current display page includes a first object,determine to enter the first state; or in response to recognizing a datainput instruction, determine to enter the first state.
 17. The apparatusaccording to claim 16, wherein the processor is further configured to:send second data to the first apparatus, the second data including aninput object that needs to perform text input.
 18. The apparatusaccording to claim 17, wherein: the second data further includes acontext attribute of the input object, the context attribute being usedto indicate a type of text that the input object needs to input.
 19. Theapparatus according to claim 17, wherein the processor is furtherconfigured to: process a first content in the current display page intothe encrypted second data and send the encrypted second data to thefirst apparatus; and receive the encrypted first data associated withthe input object returned by the first apparatus based on the seconddata.
 20. The apparatus according to claim 13, wherein the first data isdata received by the first apparatus to trigger input from an inputdevice of the first apparatus.